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How To Go Fronn PC to Cross 
Platfomn Development Without 
Killing Your Studio 
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We Are a PC Shop lhat 
Recently Added Console. 




CMP 




• Some of thistaIk may seem elementary 
to console-exclusive developers... 

• ... but each one of these Issueshas 
burned an actual project. 

• Experienced console devs will still find 
useful Info here. 
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This Isa High-Level Talk 



i;..i 


WWW.GDCONF.COM 






IhisTalkisBased On: 



• Ourwork at Valve 

• My work elsewhere 

• Interviews with others throughout 
industry 
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What Land mines Await A PC 
DeveloperGoing To Console? 
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Consolesane like PC&.. 




Closed Platform 


ManufactunerQA 


Limited Memory 
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Common Problemsof 
Crossplatfoim Development 


• Developer Efficiency 

• Certification Failure 

• User Experience 

• Programming Issues 
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Targeting Console is Similar 
to Targeting a Minspec PC 


• Valve a Iways tie ns our PC experience 


High-end (Shader Model 3) 


Midrange (Shader Model 2) 
Low-end (DirectX 8) 
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Now We Know Where The 
MinesAre... 
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Common Problemsof 
Crossplatfoim Development 


• Developer Efficiency 

• staff allocation 

• Trouble Iterating 


i • Certification Failure 

• User Experience 

• Programming Issues 
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Ihe Core Team 



• The Console Person 

• Your most experienced programmer. 

• Understandsthe entire codebase. 

• Seniorenough to affect schedule. 

• Gets the game running for the first 
time. 

• Becomesan oracle by project end. 


CMP 


IVALVEI 


WWW.GDCONF.COM 






Ihe Core Team 



• The ICR (TechnicalCertification Requirements) 

Expert 

• Producer, Prog rammer, or Q A. 

• Lea ms every item on Microsoft/Sony's 
c ertific atio n c hec klist. 

• Builds test cases. 

• TCRisnota job forone programmer. 

• Does need one person in change. 
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Ihe Core Team 



• The DevkitGuv 

• Gets people up and running. 

• Sets up artists to look at their levels, 

• Gets prog rammers set up with their 
debugger. 

• Isn't a full time job, but can be a major 
distraction. 

• Doesn't need to be a lead. 
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Common problemsof cross 
platform development 


• Developer Efficiency 

• staff allocation 

• Trouble Iterating 

• Certification Failure 

• User Experience 

• Programming Issues 
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Problem: Iteration is slow. 



• Iterating on PC: 


• Iterating on Devkit: 
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Keep your PC version 
working. 


• Debug and load times always faster 
on PC than console. 

• Runtime iteration much easier on PC 

• Edit & continue 

• Reloading assets 

• Compiling slower for console target 
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Simulate console content 
features on PC 


• PC workflow is more comfortable for 
artists 

• PCsane cheaper than devkits 

• Encourages experimentation 
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Cross platform assets 



• Consoles have their own formats. 

• Do you byte swap on load? 

• Consoles prefer assets compiled into 
big files. 

• PCs have disk caches 
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Ihe Catch-22: 



Load asset files 
individually: 

@ la unc h times longer 

® Changing data faster 
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Compile paks: 

@ code changesfaster 
@ data changesslower 
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Our hybrid solution 



• Compile asset tree into 
pa ks nightly. 

• Artists specify individual 
assets to override locally 

• Best of both worlds 
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Branch In Pipeline, 
Not In Source 


• You will need to 
recompile every asset 

• Try not to diverge assets 

• Make tools deal with 
platform differences, 
instead of artists. 

• Keep the source a It for 
everything. 
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Common problemsof cross 
platform development 


• Developer Efficiency 

• Certification Failure 

• OutOfMemory 

• Starting Too Late 

• Multiplayer 


• User Experience 

• Programming Issues 
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Technical Certification Requirements/ 
Technical Requirement Checklist/ 
CERT 


• Ihe process by which 
console manufacturer 
ensures quality. 

• A specific list of 
requirements that your 
game must meet. 

• Pass, or do n't ship. 
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Most Common Problems: 



• Stability 

• Ul - very specific requirements 

• Savegames 

• Need to be completable with no save 
media 

• Online / UVE 
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Problem: 

Game RunsOut Of Memory. 
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Memory 



• Memory is critic ally strict. 

• The #1 reason levels get changed. 

• The lateryou wait, the more drastic the 
cuts. 

• You will alwayswish you had worried 
about memory sooner. 

• Ac count for everything. 
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Dynamic Allocation Is Bad. 



• If you don't know how much memory 
you're going to need, you don't 
know if you're going to run out. 

• PC games tend to allocate memory 
ad-hoc. 

• Keep track of where it goes 
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Where Does Memory Go? 



• Executable code 

• Does not change at runtime. 

• Assets 

• Textures, level geometry, models, 
animations, sound, sprites,... 

• Loaded into memory from disk. 

• Heap 

• Data generated at runtime by code. 

• Anything that is not assets. 
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Assets Have Grown Faster 
lhan Heap. 


Half-Ule 2 Memoiy Use 


512r 






384 

256 

128 

0^ 





□ Assets 

□ Heap 
■ Code 


XBOXl XBOX 360 
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Squeezing assets, Step 1: 
Account. 


• Track every asset allocated. 

• Emit spread sheets for each level. 

• Automate this process. 

• Do it every night. 

• Will highlight all serious problems.. 

• ...and make new ones obvious. 
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Squeezing assets, step 2: 
Compress 


• Use platform-specific formats. 

• XMA, AAC have good ratios 

• Leverage yourshaders' and SPU's 
power 

• Comp ness norma I maps, grayscale 
textures, animations... 

• May need to split up textures 
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Squeezing assets, step 3: 
Reduce. 


• Budget your 
textures/ models 
/ meshes 
carefully. 

• It'seasy to just 
downsample all 
your textures... 

• Butyoucanget 
much better 
results with careful 
targeting. 

IVALVEI 
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Squeezing textures 

• 20% of the textures are 80% of the problem. 

• Source hastoolsto show uswhich 20% 
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Squeezing textures 



• Halving one 1024x1024 texture saves as much 
memory aseliminating 32 128x128's. 

• Focuson what's actually visible, so you can 
reduce where no one will notice. 
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Squeezing assets, step 4: 
Maintain. 


• Staying in memory is everyone's job. 

• Know exactly when and where 
regressionsoccur. 

• Find exactly which change to blame. 
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Squeezing assets, step 5: 
Pa nic. 


• If a II e Ise fa ils... sp lit leve Is. 

• Remove characters. 

• Decimate textures. 

• Downsample animation. 

• Dealing with memory sooner will 
spare you all these painful measures. 
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In An Ideal World 


• Memory would be allocated at load 
time... 



Entities 


Code 

Geometry 

Textures 

Sound 


Stack 
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Managing Heap Growth 



• Many games load assets ad hoc 

• Textures, models, animations, sound 

• Code generatesdata too 

• Spawning entities, particle systems, Al 
state... 

• Crashes most likely in level loads 
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mallocO Considered Harmful 

( new/delete too ) 


• Game play systems mo St likely source 
of leaks. 

• Good containerc lasses provide 
easier management, less leakage. 

• Only if you write yourown allocator! 
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WHYTO: Make A Custom 
Memory Allocator 



CMP 


Replace mallocO, callocO, new, etc. 
with yourown code. 

Better than STUDIO NEW, 

STUDIO DELETE ma c nos: 

No big search and replace. 

You can't fix aII the new/deletes in 3d 
party libraries... 

... so linkthem to yourown allocator. 
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HOWTO: Make A Custom 
Memory Allocator 


• Override every function in the CRT.obj that 
containsmalloc: 

• ma Hoc, free, c a Hoc, realloc... 

• Put your implementation in its own .cpp 

• Unkthis .cpp to every project in yourgame. 

• Only works if you override the whole 
module... 

• ... so you need to re-do this if you change 
compilers or CRTs. 
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pwn your memory 



• If you own every allocation, you can track 
every allocation. 

• Even those conning from the STL 

• Write global fixed-size pool allocators. 

• Limit fragmentation. 

• Look up the Ihanslation Lookaside Buffer. 
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Track Memory Based On 
Exactly Who Allocates It 


• Budget asset allocation by type 

• Texture, geometry, sound... 

• Budget code allocation by purpose 

• AI::Navmesh, Particles, Rendertarget... 

• Notstd::vector<int> 
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Track Memory Based On 
Exactly Who Allocates It 



CMP 


Thingy *WasteMemory( Thingy* input, 
std::vector<Thingy> &list ) 

{ 


MEM_ALLOC_CREDIT(IMPORTANT_SYSTEM); 
globalSystemList.AddToTail(input); 
list.append(*input); 

Thingy *output = new Thingy; 
output = DeepCopy(input); 
return output; 
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Be Careful With Containers 



• Container classes mean more: 

• Dynamic allocation 

• Range checking 

• Copying thingsanound 

• Use std::vec to nine serve 
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We Do Ihis Work For PC Too 



• Diskswapping bad! 

• Bud get tracking means reliable 
information everywhere. 

• Retrofitting later means touching a 
thousand different places. 
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Common problemsof cross 
platform development 


• Developer Efficiency 

• Certification Failure 

• OutOfMemory 

• Starting Too Late 

• Multiplayer 


• User Experience 

• Programming Issues 
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other Interesting TCRs 



• Load times no more than Xseconds 

• Letting people play their MP3 
collection in yourgame. 

• Minimum refresh interval... even while 
loading. 

• Compiled with recent SDK. 
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CMP 


Solve It In Design 



• Make cert requirements part of your 
architecture. 

• Think a bout Achievements/ Skill Pointsin 
yourdesign. 

• (you can get them on PC with SteamWorks) 


engaging playerduring load in Call of Duty 4 


WWW.GDCONF.COM 




Savegames 


• Use sma II ind ivid ua I files, not o ne 
large package 

• Fits on memory cards. 

• Deal with losing memory card during 
save. 

• Do you really need save-anywhere? 

• If you rely on quicksave, 

• preallocate a RAM disk big enough. 
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• Consider title-safe and widescreen 

• Be readable in 4:3 SD and 16:9 720p. 

• Be readable in 4:3 SD... in German. 

• ICR has specific requirementsforUI layout & 
flow: 

• Need a way to pop dialogson top 

• Manufacturer-approved graphics, names 

• This usability work makes your PC game 
better. 
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Common problemsof 
ctDssplatform development 


• Developer Efficiency 

• Certification Failure 

• OutOfMemory 

• Starting Too Late 

• Multiplayer 

• User Experience 

• Programming Issues 
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Multiplayer/ UVE 



• Wasthe majority of ourcert issues 

• Start working on this from day #1. 

• Do your preliminary work in sample a pps 

• Do not let it be blocked by engine 
development. 

• Rich presence may require 
architecture changes 

• Enlist Microsoft/Sony's help. 

• They have lotsofgood tooisforyou. 


CMP 


Cort i s pi ayi ng IF: BadI ands! 
/^ead3-2inCTF 


RDCONF.COM 






M u Itip la ye r Testing 



• Your office LAN is not the Internet. 

• Debugging without encryption, voice hides 
problems. 

• Some problems a rise only with high load. 

• Do a beta if you can. 

• Latency, bandwidth, ping, problemsas 
always... 
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MultiplayerTesting: Simulate 
YourOwn Network Backbone. 
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Common problemsof 
ctDssplatform development 


• Developer Efficiency 

• Certification Failure 

• User Experience 

• Load limes 

• Use of multicone 

• Controls 

• Programming Issues 
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Problem: Game TakesToo 
Long To Load. 
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Optical Load limes 


PROBIEM 

soixjnoN 

Seeks 

Contiguous files, careful 
layout 

Misaligned reads 

1 

Sector alignment 

Buffered access 

Unbuffered DMA I/O 

Synchronous stalls 

Asynchronous loading 

Small files loaded on 
demand 

Large, single files 

IVALVEI 
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, 1 ^ Ihingsfhat Make A DVD 

sidL Lead Faster 

0 

• .ZP files 


• Compression 

• (trade CPU for I/O bandwidth) 

• Asynchronous loads in a separate thread 
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How We Refit Our Game 
Without Rewriting Everything 
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Three CategoriesOf Data 



• Big 

• Textures, models, BSP, sprites, SFX 

• Small 

• Config files, scripts, <4koddsand ends 

• Really Big 

• Dialog, long animations 

• Stuff you don't need rightaway 
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Synchronous (naive) loading 
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Asynchronous loading 



























































Key features 



• I/O thread does unbuffered DMA 
transfers. 

• Keepsthe disk spinning continuously. 

• Lockless implementation 

• Trade CPU/SPUforl/O bandwidth 

• Return dummy values to sync loads. 
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Really big files: streaming 


• Store the first ¥2 sec of each 
animation and audio always 

• Asynchronously load the rest in the 
background 

• Need a resource abstraction layer 
that can say: 

• We have the data 

• We're getting the data 

• We will never get the data 


IVALVEI 


WWW.GDCONF.COM 






Sma II files 



Pnecompile all small ad-hoc files into one 
large blob 

Read it in one operation with level 

Create a fake file system 

Don't have to change game code! 


CMP 
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Know In Advance Each 
Level's Resource Needs 


• If you're going to build a pak, you 
need to know what goes in it. 

• Every single asset. 

• Analyze loading dependencies. 

• Crash when loading out-of-pak. 
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Common problemsof cross 
platform development 


• Developer Efficiency 

• Certification Failure 

• User Experience 

• Load limes 

» Use of multicone 

• Controls 

• Programming Issues 
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Going Multithreaded: 

It's not next-gen any more. 



Xenon 


Cell 
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AMD Barcelona 
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All Major Platforms A re 
Multicone. 


• 360: 3 symmetric PowerPC cores, 6 
threads 


• RS3: 1 PowerPC, 2 threads; 7 vector 
processors 

• Intel/AMD: Quadcore now, 8-core 
tomorrow 
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• This is not "next gen", it is "today." 
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Ourtechnique: 
Discussed here before 


"Dragged Kicking and Screaming: 
Source Multicore" 

Tom Leonard (Valve), GDC 2007 


http://www.va lvesoftware.conn/publications.html 
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J ob queues: a summary 



® A job iscode and local data 

® Put Into a queue; otherthreads 
consume from queue 




Code 

Job -< 


Data 
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Computation Thread 


Computation Thread 
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Code 

Code 


Code 

Data 

Data 


Data 
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Code 

Data 


Code 


Code 

Data 


Data 
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Worked Betterlhan We 
Expected! 


• O n the 360: 

• 50%performance improvementjustfrom 
queuing graphics functions 

• 4x increase in fra me rate with full 
implementation. 

• On the PS3: 

• Game wouldn't run othen/vise! 

• Our game already had a client/server 
split. 
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De-Globa lize Your Data 



• Pack jobs'data up so they work 
locally. 

• Put global data into a closure. 

• Avoid chasing pointers a II over 
memory. 

• Especially critical on PS3. 

• SPUs have only 256kb of memory. 

• Random memory accessishuge stall. 
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PS3 Requires More 
Aggressive Threading 


• All the power of the PS3 is in its Cells. 

• The PPU will be always saturated. 

• General C-H-code does not run well 
on SPUs. 

• Code memory is tight. 
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Some fhingsTo Worry About 



• Callbacks 

• Synchronizing simulation clocks 

• Mutexes (can make you slower than 
singlethreaded) 

• Hardware threads useful only in 
certain cases- measure it. 
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Common problemsof cross 
platform development 


• Developer Efficiency 

• Certification Failure 

• User Experience 

• Load limes 

• Use of multicone 

• Controls 

• Programming Issues 
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Problem: 

controls don't feel right. 

0 


CMP 


Have PC de vs test 
with 360/PS3 
controllers. 

• Yes, you can connect 
them to a PC. 

Makes everyone a 
usability tester a II the 
time. 

PS3, 360 have 
d ifferent thumbstic k 
calibrations. 
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Common problemsof cross 
platform development 


• Developer Efficiency 

• Certification Failure 

• User Experience 

• Programming Issues 

Graphics 

• Framerate / CPU 
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Hme ForGood Graphics! 




CMP 


IVALVEI 


WWW.GDCONF.COM 













TV pixel and colorspaces 
differ from monitors 
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TVs rebalance histograms 
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TVs vary in quality 



• A common office fight: 

• Lookgood on a default-settings TV? 

• Orone that'sbeen calibrated? 

• TV defa u It settings vary very widely. 

• The solution: 
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Watch TV AtThe Office. 


• Watch television on 
the displays you're 
developing with. 

• Calibrate yourTV 
so TV looksgood. 

• Don't buy the same 
W for everyone! 
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Shaders 



• PC uses HLSL Consoles use HLSL. Done. 

• Shadercompilens may be a bit different. 

• The few problems will be with the most 
complicated shader. 

• GPU/CPU powerbalance a little different. 

• Shaderconditionalsperfomn well! 

• We distribute ourshadercompiles. 

• Compile each shaderforboth platforms before 
checkin. 

• Compile everything offline nightly for regression 
testing. 
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sRGB 



• sRGB read/write curve 
different on 360. 

• Keep yoursource art 

• Compiling from 
anotherspace loses 
precision. 

• See Alex Via chos'talk: 
"Post Processing In 
The Orange Box", 

Feb 18, 2008. 

http://www.va Ivesoftware.com/ 

publications-html 
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sRGB Read 



PC Gamma to Linear 


sRGB Write 



Linear to PC Gamma 


sRGB Read 



360 Gamma to Linear 


sRGB Write 



Linear to 360 Gamma 
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other notes: 



• PIX/ GCM Hud excellent for very 
specific, actionable info. 

• Look into tiled rendering on 360 

• Makes antialiasing easier, but isn't critical. 

• If you're hung up on getting PC and 
console to match perfectly... let go. 

• No one is playing your game twice 
simultaneously side-by-side. 

• It just has to look good. 
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Common problemsof 
ctDssplatform development 


• Developer Efficiency 

• Certification Failure 

• User Experience 

• Programming Issues 

> Graphics 
• Framerate / CPU 
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360, PS3 have in-order 
PowerPC CPUs 


• They do not rearrange instructions to eliminate 
dependencies. 

• Sloppy code runs more slowly. 

• Why? Reordercincuitry iscostly, takesup space... 

• ...space now used foradditional entire cores! 
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In-orderPPCsrun sloppy 
code mote slowly than x86 


• 25%-50% sp eed fo r stra ig ht c no ss- 
compiled code. 

• Careful optimization gets close to parity. 

• SIMD a bigger win on PPC than x86. 

• Rememben on 360 you have three of 
them. 
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LEARN THE ASSEMBLY 



• Sometimes you still have to do this. 

• Use intrinsics, understand what they 
are doing. 

• Helpsdebug release-build crashes. 

• Learn the calling convention, 
how to augurcrash clumps. 

• Double-check what compileremits 
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LfARN THE PIPEUNE 



• PPCsane high-latency, high- 
throughput 

• Learn about all the hazards 

• Registerdependency, load-hit-store, 
cache miss, microcode, ERAT, TIB... 

• Understand whatthe profiler is telling you. 

• 80%of perf from touching 20%of code. 
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Actually Use SIMD 



• Abstract interface 
for a II platforms. 

• Push native vector 
class everywhere. 

• Replace doubles 
with floats 


FORCEINLINE Vector Add ( const Vector & a, 
const Vector & b ) 

{ 

#ifdef _X360 

return ^vaddf p ( a, b ); 

#elif defined(_SSE) 

return _min_add_ps ( a, b ) ; 

#else 

return Vector( a.x+b.x, a.y+b.y, 

a.z + b.z, a.w + b.w ); 

#endif 

} 
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#ifd ef Is Not The Wa y To G o 

• Compilerswill elide code in an if() 
block that is always false. 
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#define IsX360() true 
#define IsPC() false 

void DoStuffO 

{ 

if ( IsX360() ) 

{ 

PlatformSpecificFunction() ; 

} 

else if ( IsPC() ) 

{ 

WindowsSpecificFunction(); 

} 

else 

{ // you might be on the Wii one day! 

GeneralCaseFunction(); // or throw an assert 

} 

} 
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Use if() Instead of #ifdef. 



• Stops "the PC guys broke the PS3 build 
again!" 

• You may need stub functions 

• Don't assume "if" PC "else" 360. You 
might be on PS3 orWii one day. 
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Not All Optimization Is 
Premature 


• Don't "do a big perf passatthe end". 

• Getting from Sfpsto 15fpsisn't 
optimization, it's a key feature. 

• Have budgets from the start, 

• Have tools to stay inside them. 
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Things you need to buy: 
Devkits 


• Development kits 

• Live debugging 

• Engine, system prog rammers- 
anyone whose bugs block 
someone else 

• Test kits 

• Printf debugging. 

• Artists, QA, maybe gameplay 
programmers. 

• Prepare forfailune rate. 
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O the r Sug g estio ns 



• For your first title: keep it simple! 

• Keep people on kits. 

• Work to the most constrained 
platform. 
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Measure Everything 



• Measure everything yourself, as often 
asyou can. 

• Take nothing for granted. 

• Verify your compiler output. 
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Recap 



• Make cert part of yourdesign. 

• Memory will always be a struggle. 

• Automate offline testing. 

• Regression is a bigger problem in cross- 
platform development. 

• Keep the PC version working! 


• Most importantly... 
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DO UNOW 



• The SO oner you Start, 
the better off you 
will be. 

• Manufacturing lead 
timesare longeron 
console, and you 
ha ve IRC. 
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Ihe Terrible Sec ret Of Cross- 
Platform Development: 
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AIIThisWill Make Your PC 
Title Better! 


• IRC is just a group of good usability rules. 

• Memory efficiency helped us on every 
platform. 

• PC games deserve shorter load times. 

• Making money on the PC means hitting the 
low end. 

• If it runs well on console, it'seasy to make it 
run well on PC. 

• Steamworkseven letsyou have achievements 
and updates! 
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For questions and 
answers, please go to: 


http ://a ssemblvreauired.wordpres5.com 


See other Valve 
presentations at: 

http:// WWW. va lvesoftware.conn/Dublications.htnnl 
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